| Average word length | # of sentences | Source |
|---|---|---|
| 6.51 | 12 | The Legend of No Man's Land |
| 6.74 | 10 | Daftar episode OB |
| 6.82 | 10 | Lokasi di One Piece |
| 6.92 | 17 | Pertempuran Laut Karang |
| 7.03 | 11 | Kamen Rider Kiva |
| 7.03 | 19 | Ronaldowati |
| 7.09 | 10 | Pak Belalang |
| 7.17 | 10 | Marapu |
| Average word length | # of sentences | Source |
|---|---|---|
| 7.17 | 10 | Marapu |
| 7.09 | 10 | Pak Belalang |
| 7.03 | 11 | Kamen Rider Kiva |
| 7.03 | 19 | Ronaldowati |
| 6.92 | 17 | Pertempuran Laut Karang |
| 6.82 | 10 | Lokasi di One Piece |
| 6.74 | 10 | Daftar episode OB |
| 6.51 | 12 | The Legend of No Man's Land |
The problem addressed in this subsection (as well as the results) is similar to 6.4.1.1, but now we focus on average word length instead of average sentence length.
Measuring average word length strongly depends on tokenization. The usual tokenization might split the string “28.06.2005” into five parts “28 . 06 . 2005” of average length two. To avoid this, the number of words is counted as 1 + (number of blanks in the sentence).
select round(avg(length(sentence) / (1+ length(sentence) - length(replace(sentence," ","")))),2) as le, count(sentence) as cnt, source from sentences s, inv_so i, sources so where s.s_id=i.s_id and i.so_id=so.so_id group by source having cnt>=10 order by le limit 30;
6.4.2.2 Average logarithmic word rank for different sources
6.4.2.3 Sources consisting of many / few words with frequency 1
6.4.2.4 Sources with low / high average word length of rare words